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We study the nature of phase transition in classical Heisenberg model on triangular lattice with 
competing interactions. In frustrated systems, various types of phase transitions occur depending 
on the lattice and spin symmetries. Recently, a first-order phase transition with threefold symme- 
try breaking in frustrated Heisenberg model on triangular lattice was discovered [R. Tamura and 
N. Kawashima, J. Phys. Soc. Jpn. 80, 074008 (2011)]. To change the underlying symmetry, we 
introduce a uniaxial distortion effect into their model. We find the order of the phase transition 
changes into the second order when the spontaneous breaking of the twofold symmetry occurs. 
Moreover, dissociation of Z2 vortex pairs occurs at the second-order phase transition point. 
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Geometrically frustrated magnets (GFMs) have been 
studied exhaustively in a wide range of areas [lj-Q- I n 
GFMs, occurrence of novel phase transitions associated 
with unconventional order parameters, existence of exotic 
ground states (GSs), and appearance of unconventional 
dynamical nature have been predicted theoretically and 
found experimentally. A number of examples in which 
theoretical calculation gives close agreement with exper- 
imental results of GFMs have been reported 0-0|. More- 
over since recently there have been found new GFMs 
which exhibit theoretically uninvestigated nature ToL [Tl | . 
theoretical studies of GFMs and investigations of resul- 
tant predictions have increased importance. 

In geometrically frustrated systems, GS is not the con- 
ventional ferromagnetic state nor the Neel state in gen- 
eral. Non-collinear states such as the spiral-spin struc- 
ture and the 120-degree structure become the GS. To 
describe such a spin structure, a characteristic degree of 
freedom such as chirality should be introduced. More- 
over, a phase transition relating to the degree of free- 
dom can take place in continuous spin systems even in 
two dimension where true long-range order of spins at 
finite temperature is prohibited by the Mermin- Wagner 
theorem [12|. For instance, the antiferromagnetic XY spin 
system on triangular lattice exhibits order-disorder tran- 
sition associated with chirality [l3|, and the Z2 vortex 
transition was reported in the antiferromagnetic Heisen- 
berg spin system on triangular lattice ["bij. Quest for pe- 
culiar phase transitions which never occur without frus- 
tration has been done for a long time. 

It has been reported that some continuous spin sys- 
tems with competing interactions exhibit a phase tran- 
sition with spontaneous breaking of discrete symm etry 
corresponding to the lattice and spin symmetries [15l423| . 
In many cases, nature of phase transition is intuitively 



plausible from the symmetry that is broken at the tran- 
sition point. However, a couple of unexpected phase 
transitions were reported. For example, in the J1-J2 
XY model on square lattice, although a phase transi- 
tion with twofold symmetry breaking occurs, it does not 
belong to the universality class of the two-dimensional 
Ising model[l6|. Moreover, there has been recently found 
that the Heisenberg spin system on triangular lattice 
with the nearest-neighbor ferromagnetic interaction J\ 
and the third nearest-neighbor antiferromagnetic inter- 
action J3 (J1-J3 model) exhibits a first-order phase tran- 
sition with threefold symmetry breaking [18l 121]. This is 
also an unexpected phase transition since the order of 
the phase transition with breaking of the threefold sym- 
metry in two dimension is usually the second order from 
the knowledge of the Potts model[24|. In this way, even 
now, geometrically frustrated systems have shown novel 
results. 

In this paper, to investigate relationship between the 
symmetry that is broken at the transition point and na- 
ture of phase transition in continuous spin system with 
competing interactions, we introduce a uniaxial distor- 
tion parameter into the J1-J3 model [H, Hi]. In the 
model, we find that a second-order phase transition with 
twofold symmetry breaking occurs at finite temperature 
for a finite range of the distortion parameter. Further- 
more, we confirm the phase transition belongs to the uni- 
versality class of the two-dimensional Ising model. 

We consider the following Hamiltonian: 

H= AJi ^2 s i ' S J + ^1 Si ' s i 

(* 5 j)axisl (* 5 j)axis 2,3 

Yl Si ' s i> A > 0, J 3 > 0, (1) 
where the first term represents nearest-neighbor interac- 
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tions along the axis 1, the second term denotes nearest- 
neighbor interactions along the axes 2 and 3, and the 
summation in the third term takes over the third nearest- 
neighbor spin pairs (see Fig.QJa)). The variable is the 
three-dimensional vector spin of unit length, and A is a 
uniaxial distortion parameter. Let the number of spins 
be N(= Lxi), where L is the linear dimension. Here- 
after we refer to this model as distorted J±-Js model. In 
Ref. [21], the authors studied thermodynamic properties 
of the model for only A = 1 and found that a first-order 
phase transition with breaking of the threefold symmetry 
occurs when the threefold symmetry is broken in the GS 
(i.e. — 4 < J1/J3 < 0). Since in the GS for the other re- 
gion of J1/J3 for A = 1, no discrete symmetry is broken, 
we focus on the parameter region in this paper. 

In general, the GS of the classical Heisenberg model 
can be represented by the wave vector k* at which the 
Fourier transform of interactions J(k) is minimized. In 
the distorted J±- J3 model, J(k) is given by 



(a) k* = ±(5tt/18, 16tt/18\/3) 



k* = ±(5tt/18, -16tt/18a/3) 



J(k) AJi 



cos k x 



2 J \ k x 

— — cos — cos 
Js 2 



V3k y 



NJ 3 J 3 

+ cos 2k x + 2 cos k x cos V3k y . 



(2) 



Notice that the spiral-spin state represented by k and 
that by — k are the same structure in the Heisenberg 
model. Figure 0Jb) summarizes positions of k* in the 
first Brillouin zone depending on A. When < A < 1, 
there are two wave vectors k* = ±(fc* 7^ 0, k* = 0). In 
this case, no discrete symmetry is broken in the GS. For 
only A = 1, there are six wave vectors k* and the three- 
fold symmetry is broken in the GS as stated in Ref. [21] . 
If we increase A from unity, there are four wave vectors 
k*. Then, the twofold symmetry is broken in the GS. 
Moreover for large A (> Ao obtained by Eq. (|SJ)), the 
wave vector k* is given by k* = ±(fc* = 0, fc* 7^ 0) and 
no discrete symmetry is broken in the GS. In this way, 
the symmetry that is broken in the GS can be changed 
by tuning A. In the following, we focus on the parame- 
ter region 1 < A < Ao, since nature of phase transition 
with breaking of the twofold symmetry has not been in- 
vestigated in continuous spin system on triangular lat- 
tice. Note that the above mentioned all spin configura- 
tions have SO (3) symmetry reflecting the global rotation 
of all spins. 

In order to obtain the equilibrium values of phys- 
ical quantities with high accuracy, we perform the 
Monte Carlo simulation using the single-spin- flip heat- 



bath method and the over-relaxation method 25, 2 



First, we study the nature of phase transition in the 
distorted J\- J3 model with periodic boundary condition. 
To avoid extra stress caused by boundary effect, we use 
the parameter set such that the GS can be represented 
by the commensurate wave vector. We consider the 
case that the wave vectors k* which minimize J(k) are 
k* = ±(5tt/18, 16tt/18V5) and ±(5tt/18, -16tt/18V5). 



axis 1 " r,(rV -4 , 

(t>) U 2VT 




FIG. 1. (Color online) (a) Schematic picture of two distinct 
GSs of the distorted J1-J3 model for J1/J3 = —0.4926 • • • and 
A = 1.308 • • •. The bold lines indicate AJi. (b) A-dependence 
of k* which are denoted by the circles in the first Brillouin 
zone depicted by the dotted hexagon, (c) Structure factor 
S(k) at one of k* as a function of temperature. Structure 
factors in the first Brillouin zone at several temperatures are 
also shown. The lattice size is L — 144. 



In the GS spin configuration in the case, the angle be- 
tween nearest-neighbor spins along the axis 1 is 50-degree 
and that along one of the axes 2 and 3 is 55-degree and 
the other is 105-degree as shown in Fig. QJa). We obtain 
Ji/ J 3 = -0.4926 • • • and A = 1.308 • • • using Eq. ©. Fig- 
ure [He) shows temperature T dependence of the struc- 
ture factor at k* = (5tt/18, 16tt/18-s/3) for L = 144 when 
the GS spin configuration is represented as the left panel 
of Fig. QJa). The structure factor is defined as 



s w : =^E< s ^> e " lk ' (r *" r3) ' 



(3) 



^,3 



where the summation takes over all of the spin pairs 
and represents the position vector of the i-th site. 
Throughout the paper, (O) denotes the equilibrium value 
of the physical quantity O and the Boltzmann constant is 
set to unity. As temperature decreases, 5(k*) monotoni- 
cally increases. The structure factor in the first Brillouin 
zone at several temperatures is also shown in Fig. ffl^c), 
which suggests the twofold symmetry is broken at low 
temperature (27|. 
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We calculate temperature dependence of specific heat 
for L = 144 — 288. The specific heat is calculated as 



C = ((E 2 )-(E) 2 )/T 2 



(4) 



where E is the internal energy per site. Figure [2^a) shows 
the specific heat as a function of temperature and indi- 
cates the existence of a phase transition at finite tempera- 
ture. To confirm the occurrence of a spontaneous twofold 
symmetry breaking, we define an order parameter m by 
using a local quantity at each upward elementary 
triangle t depicted by the shaded triangles in Fig. QJa): 



m 



5>«/AT, (5) 



where the definition of the subscript of spins is shown 
in Fig. [2fb) and the summation takes over all upward 
elementary triangles. Since the order parameter repre- 
sents the difference between the relative angle of nearest- 
neighbor spins along the axis 2 and that along the axis 
3, it can appropriately describe the twofold symmetry 
breaking in our model. Figures [2fb) and (c) show the 
temperature dependence of (m 2 ) and U4 := (m 4 )/(m 2 ) 2 , 
respectively. These figures indicate the existence of 
the second-order phase transition with breaking of the 
twofold symmetry at T c / J3 = 0.4950(5) where the Binder 
ratios for some lattice sizes cross. 

Since the spiral-spin states in the GS of antiferromag- 
netic Heisenberg spin systems on triangular lattice have 
SO (3) symmetry, the order parameter space is isomor- 
phic to P3 and the point defect is 7ri(Ps) = Z2. Because 
of the existence of Z2 point defect, the dissociation of Z2 
vortex pairs occurs at finite temperature IHI23. TheZ 2 
vortex labeled by or 1 is defined by the vortex configu- 
ration of spin and vector chirality. In order to confirm the 
dissociation of Z2 vortex pairs in our model, we calculate 
the number density of Z2 vortices n v by using the same 
manner as in Ref. A plot of lnn v versus J3/T in 

our model is shown in Fig. Efd), and it is confirmed that 
n v obeys well the Arrhenius law below T c . This result 
indicates that the dissociation of Z2 vortex pairs occurs 
at the second-order phase transition point. Note that Z2 
vortex pairs dissociate at the phase transition point was 
also found for A = 1[21|, but, in the case, the order of the 
phase transition is the first order. Hence, it is concluded 
that the phase transition associated with breaking of dis- 
crete symmetry and the dissociation of Z2 vortex pairs 
occur simultaneously regardless of the order of the phase 
transition in our model. 

To clarify the universality class of the phase transition, 
we perform the finite-size scaling using the following re- 
lations: 

U A oc f((T - T C )L^), X oc L 2 "M(T - T^L 1 '"), (6) 

where the susceptibility x is defined as x := NJs(m 2 )/T 
and /(•) and g(-) are scaling functions. The obtained 
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FIG. 2. (Color online) Temperature dependence of equi- 
librium physical quantities of the distorted J1-J3 model for 
J1/J3 = -0.4926- •• and A = 1.308 (a) Specific heat 
C. (b) Square of the order parameter (m 2 ). (c) Binder ra- 
tio Ua- (d) Log of number density of Z2 vortex n v versus 
J3/T. The dotted vertical line indicates the transition tem- 
perature T c /J3 = 0.4950(5). (e) and (f) Finite-size scaling of 
the Binder ratio U4 and that of the susceptibility x using the 
critical exponents of the two-dimensional Ising model (y — 1 
and 77 = 1/4) and the transition temperature. Error bars 
are omitted for clarity since their sizes are smaller than the 
symbol sizes. 



results using v = 1 and 77 = 1/4 which are the critical 
exponents of the two-dimensional Ising model and the 
obtained T c are shown in Figs.[2je) and (f). Since all the 
data collapse onto scaling functions, it is confirmed that 
the second-order phase transition in our model belongs 
to the universality class of the Ising model. 

Next, to obtain the relationship between A and T c , we 
consider the case of J1/J3 = — 0.7342 • which is used 
in Ref. [2l| with changing the value of A. For A = 1, the 
model exhibits a first-order phase transition with break- 
ing of the threefold symmetry at T c /J 3 = 0.4746(1) [21^. 
We here study the nature of phase transition of the dis- 
torted J\- J3 model with open boundary condition. From 
the analysis of the GS as explained before, a phase tran- 
sition with breaking of the twofold symmetry is expected 
to take place for 1 < A < Ao(= 2.8155 • • •) in this case. 
By analyzing the Binder ratio, we obtain A-dependence 
of transition temperatures as depicted in Fig. [3ja). An 
enlarged view near A = 1 is shown in the inset of 
Fig. [3ja). This figure indicates the transition temper- 
ature near A = 1 smoothly connects to the transition 
temperature for A = 1 and the transition temperature 
goes continuously to zero when A —> Ao- Figures [3](b) 
and (c) represent the finite-size scaling analysis of the 
Binder ratio and that of the susceptibility for A = 1.5 
using z/ = l, 77=1/4, and T c /J 3 = 0.5521(1) as well as 
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FIG. 3. (Color online) (a) Phase diagram of the distorted 
J1-J3 model for J1/J3 = — 0.7342 •• •. The inset is an en- 
larged view. The open square indicates the transition tem- 
perature for A = 1 where a first-order phase transition with 
threefold symmetry breaking occurs [2l|]. The solid circles rep- 
resent transition temperatures at which a second-order phase 
transition with twofold symmetry breaking occurs, (b) and 
(c) Finite-size scaling of the Binder ratio U4 and that of the 
susceptibility % for A = 1.5 using v = 1 and 77 = 1/4 which 
are the critical exponents of the two-dimensional Ising model. 
The transition temperature is decided as T c / J3 — 0.5521(1). 
Error bars are omitted for clarity since their sizes are smaller 
than the symbol sizes. 



the previous case. In this case, all the data collapse onto 
scaling functions. By the same procedure as the previ- 
ous case, we obtain transition temperatures which are 
indicated by the solid circles in Fig. [3fa). Thus, we con- 
clude that a second-order phase transition with breaking 
of the twofold symmetry occurs and it belongs to the 
two-dimensional Ising model universality class in the pa- 
rameter region where twofold symmetry is broken in the 
GS within the calculated parameters. 

In this paper, we investigated nature of phase transi- 
tion in classical Heisenberg model on triangular lattice 
with three types of interactions: (i) the uniaxially dis- 
torted nearest-neighbor ferromagnetic interaction along 
the axis 1 (AJi), (ii) the nearest-neighbor ferromagnetic 
interaction along the axes 2 and 3 (Ji), and (in) the third 
nearest-neighbor antiferromagnetic interaction (J3). In 
Ref. [21], the authors studied for only A = 1 (no dis- 
tortion) and they found that a first-order phase transi- 
tion with threefold symmetry breaking occurs when the 
ground state is a spiral-spin state with breaking of the 
threefold symmetry. To investigate a uniaxial distortion 
effect for phase transition, properties of the ground state 
were studied and we found that the order of the phase 
transition changes into the second order when the twofold 
symmetry is broken in the ground state. The universal- 
ity class of the second-order phase transition is the same 
as that of the two-dimensional Ising model. We also con- 
firmed that the dissociation of Z2 vortex pairs occurs 
at the second-order phase transition temperature. Al- 
though a second-order phase transition occurs in consid- 
ered A, there is still an open problem whether a first-order 



phase transition with breaking of the twofold symmetry 
occurs at very close to A = 1. This is because the prop- 
erty of phase transition is decided by not only the sym- 
metry that is broken at the transition point but also the 
structure of density of states [29|. If a first-order phase 
transition with breaking of the twofold symmetry occurs, 
a tricritical point should exist and to study its properties 
such as universality class becomes an important topic. 
From our observation, it is difficult to decide the order 
of the phase transition near A = 1 since the size depen- 
dence of physical quantities are significant and we should 
calculate very large systems with high accuracy. 

Our model exhibits both a first-order phase transition 
and a second-order phase transition by tuning the uniax- 
ial distortion parameter A. We believe that the obtained 
nature is not restricted to the considered model. This is 
because a first-order phase transition accompanied with 
threefold symmetry breaking was also shown in geomet- 
rically frustrated continuous spin systems e.g. the J1-J2 
Heisenberg model on triangular lattice and that on hon- 
eycomb lattice (20I, [22| . Moreover, the uniaxial distortion 
parameter A can be experimentally changed by pressure 
or/and chemical substitution. Then such nature is ex- 
pected to be realized in many geometrically frustrated 
magnets. 
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